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DETAILED ACTION 

1. This communication is responsive to the RCE and Amendment filed 12/10/2010. 

2. Claims 1-21 are pending in this application. Claims 1, 8, 12, 19, 20 and 21 are 
independent claims. In the instant Amendment, claims 1, 8, 12, 19, 20 and 21 were 
amended. 

3. The text of those sections of Title 35, U.S. Code not included in this action can be 
found in a prior Office action. 

Claim Rejections - 35 USC § 103 

4. Claims 1, 3-4 10-12, 14-15 and 21, are rejected under 35 U.S.C. 103 (a) as 
being unpatentable over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of 
Ostermann ("Ostermann" US Patent No.: 7,295,755)and in further in view of 
Harper et al. ("Harper ", US Patent No.: 6,476,817). 

As to claim 1, Fuller discloses an information processing apparatus for handling a 
storage medium storing content data and metadata associated therewith (such as a digital 
still camera or digital video recorder, has an embedded real-time content-based analysis 
function in the capture device to extract metadata from the digital signals. Metadata 
(descriptive information about the digital content) is formatted and stored separately 
from the content, the metadata may be formatted and combined with the digital content in 
a container format such as MPEG-7, QuickTime, or FlashPix, abstract and (such as, 
storage, image + Metadata, Figure 2A (element 700)), comprising: 
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an extracting section for extracting, from said metadata stored on said storage 
medium (such as, In one aspect of the present invention, there is an integrated data and 
real-time metadata capture system, comprising a digital capture device producing a 
digital representation of one or more forms of media content; a feature extraction engine 
integrated with the digital capture device, the feature extraction engine having a plurality 
of feature extractors to automatically extract metadata in real-time from the digital 
content simultaneously with the capture of the content; and a storage device capable of 
storing the media content and the metadata, wherein selected portions of the metadata 
are associated with selected portions of the media content, col., 4 lines, 24-35), 

wherein the extracting section performs automatic extraction in response to 
loading the storage medium and manual extraction in accordance with a user's operation 
of selecting the metadata to be extracted from a list of selectable metadata (such as, In 
one aspect of the present invention, there is an integrated data and real-time metadata 
capture system comprising a digital capture device producing a digital representation of 
one or more forms of media content; a feature extraction engine integrated with the 
digital capture device, the feature extraction engine having a plurality of feature 
extractors to automatically extract metadata in real-time from the digital content 
simultaneously with the capture of the content; and a storage device capable of storing 
the media content and the metadata, wherein selected portions of the metadata are 
associated with selected portions of the media content, col., 4 lines, 24-35, such as, 
plurality of metadata tracks, claim 10)and such as, if the metadata is not combined with 
the digital content, the metadata may require a separate storage or digital interface 
mechanism. For example, a digital video camera that outputs digital component video 
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signals may also have a standard RS-232 serial interface for downloading the metadata, 
paragraph [0050])), 

However Fuller does not explicitly disclose wherein when performing automatic 
extraction, the extracting section automatically starts a pickup control for controlling a 
laser generator to search storage area and storage location for the metadata in the storage 
medium in response to loading the storage medium. 

Ostermann from the same field of endeavor discloses wherein when performing 
automatic extraction, the extracting section automatically starts a pickup control for 
controlling a laser generator to search storage area and storage location for the metadata 
in the storage medium in response to loading the storage medium (col., 1 lines, 48-67 and 
col., 2 lines, 33). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's 
teaching with the teaching of Ostermann, because Ostermann allow efficient automatic 
content referencing, content location, and automatic access, and electronic access's 
device eliminates the need of the display driver within the storage medium. 

Fuller further disclose wherein the information display unit displays user- 
selectable metadata in the metadata extraction window (such as, information extracted 
automatically by analyzing the audiovisual signal and extracting properties from it, such 
as key frames, speech-to-text, speaker ID, visual properties, face identification/ 
recognition, optical character recognition, col.,1 lines, 55-64, col., 4 lines, 30-45 and 
claim 20). 
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However the modified Fuller and Ostermann do not explicitly disclose (a) an 
information display unit for displaying the extracted display data and the metadata 
extraction window onto said information display area. 

Harper, from the same field of endeavor discloses (a) an information display unit 
for displaying the extracted display data and the metadata extraction window onto said 
information display area ( such as, Display 18 thus serves as an electrically alterable 
display or label attached to the casing 14 of floppy disk 10, col., 2 line 62-64 and Figure 
4). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's 
teaching with the teaching of Harper, because Harper's device eliminates the need of the 
display driver within the storage medium. 

As to claim 3 , Harper discloses wherein said information display area is 
exchangeable with another information display area. Yamaguchi from the same field of 
endeavor disclose wherein said information display area is exchangeable with another 
information display area (Figures 1 and 4). 

As to claim 4, Harper discloses wherein said information display area is 
constituted by a rewrite sheet (col., 4 line, 50). 

As to claim 7 , Harper discloses wherein said content data include at least video 
content data and said information display unit displays, in said information display area, 
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thumbnail image data extracted from said video content data on the basis of said metadata 
(col, 5 lines, 30-55). 

Claims 8 and 12 are similar in scope to claim 1 respectively, and are therefore 
rejected under similar rationale. 

Claims 10 and 14 are similar in scope to claim 3 respectively, and are therefore 
rejected under similar rationale. 

Claims 11 and 15 are similar in scope to claim 4 respectively, and are therefore 
rejected under similar rationale. 

Claim 18 is similar in scope to claim 7, and is therefore rejected under similar 
rationale. 

Claim 21 is similar in scope to claim 1, and is therefore rejected under similar 
rationale. 

5. Claims 2, 5-6, 9, 13, 16 and 17 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of 
Harper et al. ("Harper ", US Patent No.: 6,476,817) in further in view of Bloch et al. 
("Bloch" Us Patent No.: 5,754,102). 



As to claim 2 , Fuller and Harper do not disclose wherein said information display 
area is rewritable. 
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However Bloch from the same field of endeavor discloses wherein said 
information display area is rewritable (such as, "electric paper" system is that such a 
display can be re-written upon essentially limitlessly, col., 4 line, 50). 

It would have been obvious to one of ordinary skill in the art to modify Fuller and 
Harper's teaching with the teaching of Bloch. 

The motivation to combine will provide for adding/deleting data to/from the 
storage media as desired. 

As to claim 5 , Bloch discloses, wherein said information display unit displays, in 
said information display area, said display data by coding at least a part thereof (col., 2 
lines, 5-7). 

As to claim 6 , Bloch discloses a metadata editing section for editing said 
metadata in accordance with a processing result of said content data, wherein said 
extracting section extracts said display data also from the edited metadata (col., 3 lines, 
23 -36). 

Claims 9 and 13 are similar in scope to claim 2 respectively, and are therefore 
rejected under similar rationale. 

Claim 16 is similar in scope to claim 5, and is therefore rejected under similar 
rationale. 

Claim 17 is similar in scope to claim 6, and is therefore rejected under similar 
rationale. 
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6. Claims 19 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Ostermann 
("Ostermann" US Patent No.: 7,295,755) in further in view of Harper et al. 
("Harper ", US Patent No.: 6,476,817), Bloch et al. ("Bloch" Us Patent No.: 
5,754,102) and Tehranchi et al. ("Tehranchi" US Patent No.: 6,873,435). 

Claim 19 is similar in scope to claim 1, and is therefore rejected under similar 
rationale. 

However Fuller in view of Harper and in further in view of Bloch do not disclose 
information display unit displaying said display data as a barcode form by coding a part 
and a thumbnail image automatically. 

Tehranchi from similar field of endeavor discloses information display unit 
displaying said display data as a barcode form by coding a part and a thumbnail image 
automatically, (such as, Bar codes have also been used for tracking and identifying 
images. In diagnostic imaging, for example, patient identification information can be 
optically encoded directly onto a film such as for X-rays, ultrasound, col., 3 lines, 35-40, 
Figure 1 and 2). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's 
teaching with the teaching of Tehranchi. 
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The motivation to combine to provide, from an image processing apparatus, an 
output print generated from digital data, where encoded metadata identifying a data 
source and image processing variables is coupled to the output print, and to provide a 
method for image processing using such encoded metadata. 

Claim 20 is similar in scope to claim 19, and is therefore rejected under similar 
rationale. 

Response to Arguments 

7. Applicant's arguments with respect to claims 1-21 have been considered but are 
moot in view of the new ground(s) of rejection. 

Inquiry 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MESEKER TAKELE whose telephone number is 
(571)270-1653. The examiner can normally be reached on Monday - Friday 7:30AM- 
5:00PM est. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William Bashore can be reached on (571) 272-4088. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Meseker Takele/ 
Examiner, Art Unit 2175 



/William L. Bashore/ 

Supervisory Patent Examiner, Art Unit 2175 



